Data-Reusing Recurrent Neural Adaptive Filters
نویسنده
چکیده
A class of data-reusing learning algorithms for real-time recurrent neural networks (RNNs) is analyzed. The analysis is undertaken for a general sigmoid nonlinear activation function of a neuron for the real time recurrent learning training algorithm. Error bounds and convergence conditions for such data-reusing algorithms are provided for both contractive and expansive activation functions. The analysis is undertaken for various congurations that are generalizations of a linear structure innite impulse response adaptive lter.
منابع مشابه
Recurrent neural networks with trainable amplitude of activation functions
An adaptive amplitude real time recurrent learning (AARTRL) algorithm for fully connected recurrent neural networks (RNNs) employed as nonlinear adaptive filters is proposed. Such an algorithm is beneficial when dealing with signals that have rich and unknown dynamical characteristics. Following the approach from, three different cases for the algorithm are considered; a common adaptive amplitu...
متن کاملAn algorithmic approach to adaptive state filtering using recurrent neural networks
Practical algorithms are presented for adaptive state filtering in nonlinear dynamic systems when the state equations are unknown. The state equations are constructively approximated using neural networks. The algorithms presented are based on the two-step prediction-update approach of the Kalman filter. The proposed algorithms make minimal assumptions regarding the underlying nonlinear dynamic...
متن کاملAdaptive Decision Feedback Multiuser Detectors with Recurrent Neural Networks for DS-CDMA in Fading Channels
In this work we propose adaptive decision feedback (DF) multiuser detectors (MUDs) for DS-CDMA systems using recurrent neural networks (RNN). A DF CDMA receiver structure is presented with dynamically driven RNNs in the feedforward section and finite impulse response (FIR) linear filters in the feedback section for performing interference cancellation. A stochastic gradient (SG) algorithm is de...
متن کاملA Complex-Valued RTRL Algorithm for Recurrent Neural Networks
A complex-valued real-time recurrent learning (CRTRL) algorithm for the class of nonlinear adaptive filters realized as fully connected recurrent neural networks is introduced. The proposed CRTRL is derived for a general complex activation function of a neuron, which makes it suitable for nonlinear adaptive filtering of complex-valued nonlinear and nonstationary signals and complex signals with...
متن کاملIntrinsically stable adaptive recursive filters
Linear Recursive Filters and also Recurrent Neural Networks can be adapted on-line but sometimes with instability problems. Stability control techniques exist for the linear case but they are either computationally expensive or non-robust. For the nonlinear case, stability control is simply usually not performed in applications. This paper presents a new stability control method for IIR adaptiv...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Neural Computation
دوره 14 شماره
صفحات -
تاریخ انتشار 2002